Multi-viewpoint gesture recognition by an integrated continuous state machine
نویسندگان
چکیده
あらまし 複数のセンサから得られる観測データや,マルチモーダルな特徴量からなる複数の時系列データを 統合しながら,ジェスチャーなどの動的事象を識別するモデルとして,「Integrated Continuous State Machine (ICSM)」を提案する.これは,各特徴系列を個別に識別する状態遷移モジュールをそれぞれ用意し,それを連 続状態空間において動的に統合するものであり,各モジュールの信頼性を逐次計算することにより,クラスの識 別にとってより重要な入力へ,動的にフォーカスを切り替えることが可能となる.本論文では,統合に適したモ ジュールとして,連続状態空間 (実ベクトル空間) 中での状態遷移によってクラス識別を行う Continuous State Machines (CSM)を導入し,続いて,複数の CSM間における,状態の共起性に基づいた相互作用を導入する. 連続状態空間を用いることにより,モジュール内の状態遷移とモジュール間の相互作用を,いずれもエネルギー 関数最小化の枠組みで定式化することができる. 本手法の有効性を,2視点カメラを用いた手話認識に適用する ことによって検証した. キーワード 情報統合,連続状態空間,状態遷移モデル,状態の共起性,時系列パターン認識
منابع مشابه
Integrated Event Recognition from Multiple Sources
This paper proposes a system architecture for event recognition that integrates information from multiple sources (e.g., gesture and speech recognition from distributed sensors in the real world). The proposed system consists of multiple recognizers named Continuous State Machines (CSMs). Each CSM has a state transition rule in a continuous state space and classifies time-varying patterns from ...
متن کاملSimultaneous Segmentation and Recognition of Gestures for Human-Machine Interaction
Human-activity and gesture recognition are two problems lying at the core of human-centric and ubiquitous systems: knowing what activities/gestures users are performing allows systems to execute actions accordingly. State-of-the-art technology from computer vision and machine intelligence allow us to recognize gestures at acceptable rates when gestures are segmented (i.e., each video contains a...
متن کاملContinuous Body and Hand Gesture Recognition for Natural Human-Computer Interaction: Extended Abstract
We present a new approach to gesture recognition that tracks body and hands simultaneously and recognizes gestures continuously from an unsegmented and unbounded input stream. Our system estimates 3D coordinates of upper body joints and classifies the appearance of hands into a set of canonical shapes. A novel multi-layered filtering technique with a temporal sliding window is developed to enab...
متن کاملAutomatic Learning of Gesture Recognition Model Using SOM and SVM
In this paper, we propose an automatic learning method for gesture recognition. We combine two different pattern recognition techniques: the SelfOrganizing Map (SOM) and Support Vector Machine (SVM). First, we apply the SOM to divide the sample data into phases and construct a state machine. Next, we apply the SVM to learn the transition conditions between nodes. An independent SVM is construct...
متن کاملKey Video Object Plane Selection by MPEG-7 Visual Shape Descriptor for Summarization and Recognition of Hand Gestures
The use of human hand as a natural interface for humancomputer interaction (HCI) serves as the motivation for research in hand gesture recognition. Vision-based hand gesture recognition involves visual analysis of hand shape, position and/or movement. Due to co-articulation that occurs during transition from one gesture to the next, problem is encountered in continuous hand gesture recognition....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Systems and Computers in Japan
دوره 34 شماره
صفحات -
تاریخ انتشار 2003